Radio mobile terminal communication system

ABSTRACT

In this radio portable terminal communication system, a service document file is converted into a window-related document file, speech-dialog-related document file, and information sharing document file. A description of a telephone number for speech communication with a center is added to the window-related document file. The window-related document file is output to a place where the file can be used through packet communication. The speech-dialog-related document file is output to a place where the file can be referred to by a speech dialog control section ( 207 ). The information sharing document file is output to an information management section ( 204 ). The information management section ( 204 ) manages information in accordance with the general-purpose description language contents of the information sharing document file such that information can be shared between the window-related document file and the speech-dialog-related document file. Since information about windows and speech dialog is created by using a general-purpose description language in this system, the number of steps in development can be reduced.

TECHNICAL FIELD

[0001] The present invention relates to a radio portable terminalcommunication system and, more particularly, to a radio portableterminal communication system which can easily provide services such asan information search service by using speech communication and packetcommunication with a radio portable terminal, and can easily developservices to be provided.

BACKGROUND ART

[0002] Conventionally, when an information search is to be made by usingpacket communication with a radio portable terminal such as a cellphone, a search word is selected from search items displayed on thescreen of the cell phone with the cursor or a search word is input ascharacters by operating keys on the cell phone, and the search word istransmitted in the form of a packet to an information source (contentsprovider). The information source then packets information found withthe search word and sends back it to the cell phone, thereby displayingthe information on the screen of the cell phone.

[0003] In the method of selecting a search word with the cursor in thismanner, if there are many search words, they cannot be displayed on thescreen of the cell phone at once. For this reason, a user selects asearch word while switching windows. It, however, takes much time toreach a target search word. In addition, in the method of inputting asearch word as characters by operating key buttons on the cell phone,since the keys on the cell phone are small, and multiple-character keysare used, cumbersome, time-consuming operation is required.

[0004] Information searches using speech communication with a cell phoneare also available. In this case, an uttered search word is subjected tospeech recognition, and information is found from an information sourcewith the search word. This information is then converted into speech andsent back to the cell phone.

[0005] In such search by speech recognition using speech communication,although a search word can be input by speech with a cell phone, asearch result is not left as a record because it is sent back by speech.In addition, image information cannot be sent back to the cell phone.

DISCLOSURE OF INVENTION

[0006] It is an object of the present invention to provide a radioportable terminal communication system which can improve the operabilityof a radio portable terminal by facilitating the exchange of informationsearch words and data by using a speech communication function andpacket communication function, and allows a search result to be checkedin any of the forms of speech, images, and characters.

[0007] It is another object of the present invention to provide a radioportable terminal communication system which can facilitate theconstruction of a service using the above radio portable terminalcommunication system.

[0008] It is still another object of the present invention to provide aradio portable terminal communication system which can facilitate theexchange of data between a description language related to radioportable terminal windows and a speech-dialog-related descriptionlanguage in a service using the above radio portable terminalcommunication system.

[0009] It is still another object of the present invention to provide aradio portable terminal communication system which facilitate themanagement of telephone numbers used for speech communication for speechrecognition on the center side in a service using the above radioportable terminal communication system.

[0010] In order to achieve the above objects, a first radio portableterminal communication system of the present invention is characterizedby comprising a radio portable terminal having a speech communicationfunction and a packet communication function, and a center linking theradio portable terminal,

[0011] the center including

[0012] a speech recognition section which recognizes a speech signalfrom the radio portable terminal,

[0013] an information search section which searches for information inaccordance with an input search word,

[0014] a speech dialog control section which controls the speechrecognition section, the information search section, and the speechconversion section to perform a speech dialog when speech communicationis made upon dialing from the radio portable terminal,

[0015] a document file input section which inputs a service documentfile used for a service provided for the radio portable terminal, whichis created by making a description about at least window display, usedin the packet communication, in a general-purpose radio portableterminal window description language, a description about operation ofthe speech dialog control section, used in the speech communication, ina general-purpose speech-dialog-related description language, and adescription about exchange of information between the packetcommunication and the speech communication in a dedicated language,

[0016] an information management section which manages information suchthat the information can be shared between the packet communication andthe speech communication,

[0017] a document file conversion section which performs conversionprocessing for the service document file to create a window-relateddocument file for the radio portable terminal in which a description ismade about at least window display used in the packet communication, aspeech-dialog-related document file in which a description is made aboutoperation of the speech dialog control section which is used in thespeech communication, and an information sharing document file in whicha description is made about exchange of information between the packetcommunication and the speech communication,

[0018] a document file output section which outputs the window-relateddocument file to a place where the file can be referred to by the radioportable terminal through packet communication, outputs thespeech-dialog-related document file to a place where the file can bereferred to by the speech dialog control section, and outputs theinformation sharing document file to the information management section;and

[0019] a packet control section which transmits/receives information ofthe information management section to/from the radio portable terminalthrough packet communication.

[0020] In addition, a second radio portable terminal communicationsystem according to the present invention performs document conversion,upon reception of a service document file in which a description is madeabout at least window display, used in packet communication, in ageneral-purpose radio portable terminal window description language, adescription is made about the speech dialog in the speech communicationin a general-purpose speech-dialog-related description language, and adescription is made about exchange of information between the packetcommunication and the speech communication in a dedicated language,outputs a window-related document file for a radio portable terminal, aspeech-dialog-related document file, and an information sharing documentfile respectively to places where the files can be used, and exchangesinformation in packet communication and speech communication, as needed,when providing a service.

[0021] Furthermore, in a radio portable terminal communication methodaccording to the present invention, document conversion is performed,upon reception of a service document file in which a description is madeabout at least window display, used in packet communication, in ageneral-purpose radio portable terminal window description language, adescription is made about the speech dialog in the speech communicationin a general-purpose speech-dialog-related description language, and adescription is made about exchange of information between the packetcommunication and the speech communication in a dedicated language, awindow-related document file for a radio portable terminal, aspeech-dialog-related document file, and an information sharing documentfile are output respectively to places where the files can be used, andinformation is exchanged in packet communication and speechcommunication, as needed, when a service is provided.

BRIEF DESCRIPTION OF DRAWINGS

[0022]FIG. 1 is a schematic view showing an example of the overallarrangement of a radio portable terminal communication system accordingto the present invention;

[0023]FIG. 2 is a block diagram showing a more specific example of thearrangement of the radio portable terminal communication systemaccording to the present invention;

[0024]FIG. 3 is a schematic view showing an example of the outerappearance of a radio portable terminal in the radio portable terminalcommunication system according to the present invention;

[0025]FIG. 4 is a view showing a specific example of an informationsharing document file in an embodiment of the present invention; and

[0026]FIG. 5 is a view showing a specific example of a service documentfile in an embodiment of the present invention.

BEST MODE OF CARRYING OUT THE INVENTION

[0027] The present invention will be described in detail below withreference to the accompanying drawings.

[0028] As shown in FIG. 1, a radio portable terminal communicationsystem according to the present invention is comprised of a radioportable terminal 1 such as a cell phone, center 2, Internet 3, portableterminal telephone network 4, portable terminal packet network 5, andcontents provider (information source) 6.

[0029] Referring to FIG. 1, when the operator of the radio portableterminal 1 is to input information search words or data during theexecution of packet communication by the terminal 1, he/she utters themand sends the uttered speech to the center 2 through the portableterminal telephone network 4.

[0030] The center 2 recognizes the sent speech and searches theinformation files in the contents provider 6 in accordance with therecognition result through the Internet 3. Found information and thelike are converted into speech. The speech is then sent to the radioportable terminal 1 through the portable terminal telephone network 4and displayed on the screen of the radio portable terminal 1.

[0031] The operator of the radio portable terminal 1 accesses awindow-related document file (e.g., i-mode-compatible HTML (to bereferred to as C-HTML hereinafter) used in the i-mode) created by thecenter 2 from the terminal 1 through the Internet 3, makes a selectionon the window, and displays the input result obtained by a speechdialog, as in the i-mode provided by NTT DoCoMo.

[0032] In addition, the radio portable terminal 1 exchangeswindow-related information (e.g., terminal window selection resultinformation), in addition to speech-dialog-related information, throughthe portable terminal telephone network 4.

[0033] An embodiment of the radio portable terminal communication systemaccording to the present invention will be described in more detail nextwith reference to FIGS. 2 and 3.

[0034] Referring to FIG. 2, the center 2 serves as, for example, aprovider for providing services, and is comprised of a document fileinput section 200, document file conversion section 201, telephonenumber input section 202, document file output section 203, informationmanagement section 204, packet control section 205, speech conversionsection 206, speech dialog control section 207, information searchsection 208, speech recognition section 209, speech-dialog-relateddocument file 211, information sharing document file 212, andwindow-related document file 213.

[0035] A service document file 210 is input to the document file inputsection 200.

[0036] The radio portable terminal 1 is used by a user to use services,and has a speech communication function and packet communicationfunction. For example, as shown in FIG. 3, the radio portable terminal 1includes a switch 101 for switching from the packet communication modeto the speech communication mode, a switch 102 for switching from thespeech communication mode to the packet communication mode, a speaker111, a screen 112 such as a liquid crystal screen, a microphone 113, anda key operating section 114.

[0037] The contents provider 6 includes a merchandise information file601 storing merchandise information used for services, and the like.

[0038] In this system, for services provided to the radio portableterminal 1, the service document file 210 is created by making adescription about window display or operation, used in the packetcommunication mode, using a general-purpose radio portable terminalwindow description language (e.g., C-HTML), a description about a speechdialog in the speech communication mode by using a general-purposespeech-dialog-related description language (e.g., VoiceXML developed byVoiceXML Forum founded by AT&T, IBM, Lucent Technologies, and Motorola),and a description about the exchange of information between the packetcommunication mode and the speech communication mode by using adedicated language, and the created service document file 210 is inputto the document file input section 200.

[0039] The document file input section 200 sends the input servicedocument file 210 to the document file conversion section 201.

[0040] The document file conversion section 201 converts the servicedocument file 210 into the speech-dialog-related document file 211,information sharing document file 212, and window-related document file213. The document file conversion section 201 also adds a descriptionabout a telephone number for speech communication with the center 2,which is sent from the telephone number input section 202, to thewindow-related document file 213, and outputs each document to thedocument file output section 203.

[0041] The telephone number input section 202 sends the input telephonenumber to the document file conversion section 201.

[0042] The document file output section 203 outputs the respective inputdocuments. More specifically, the document file output section 203outputs the speech-dialog-related document file 211 to the speech dialogcontrol section 207, outputs the information sharing document file 212to the information management section 204, and outputs thewindow-related document file 213 to the radio portable terminal 1through the Internet 3 and portable terminal packet network 5.

[0043] The information management section 204 manages information inaccordance with the contents described in the information sharingdocument file 212 such that information can be shared between thewindow-related document file 213 and the speech-dialog-related documentfile 211.

[0044] The packet control section 205 transmits/receives a descriptionabout the exchange of information with the information managementsection 204 to/from the radio portable terminal 1 through the portableterminal packet network 5, as needed.

[0045] The speech conversion section 206 converts information which canbe converted into speech, of the information found by the informationsearch section 208, into a speech signal and outputs it to the speechdialog control section 207.

[0046] The speech dialog control section 207 performs a speech dialog bycontrolling the speech recognition section 209, information searchsection 208, and speech conversion section 206 in accordance with thecontents described in the speech-dialog-related document file 211, andexchanges information with the information management section 204, asneeded.

[0047] The information search section 208 searches for informationcorresponding to input speech information, as needed, under the controlof the speech dialog control section 207.

[0048] The speech recognition section 209 performs speech recognitionprocessing under the control of the speech dialog control section 207.

[0049] As described above, the service document file 210 is a documentfile created for services to the radio portable terminal 1 by making adescription about window display or operation, used in the packetcommunication mode, using a general-purpose radio portable terminalwindow description language, a description about a speech dialog in thespeech communication mode by using a general-purposespeech-dialog-related description language, and a description about theexchange of information between the packet communication mode and thespeech communication mode by using a dedicated language.

[0050] The speech-dialog-related document file 211 is output from thedocument file output section 203 to a place where the speech dialogcontrol section 207 can refer to the file. The information sharingdocument file 212 is output from the document file output section 203 tothe information management section 204. The window-related document file213 is output to a place where it can be used by the radio portableterminal 1 through the portable terminal packet network 5 and Internet3.

[0051] The merchandize information file 601 is set in the contentsprovider 6 to store merchandise information used for services.

[0052] An example of the operation of the embodiment of the presentinvention will be described below by exemplifying a service in whichwhen “please input merchandise name: (1) foods, (2) sundries” isdisplayed on the screen 112 (FIG. 3) of the portable terminal duringpacket communication by the radio portable terminal 1, and the userselects one of the keys “foods” and “sundries” on the key operatingsection 114, information corresponding to a recognition result on themerchandise name which is input as speech by the user with themicrophone 113 by using speech communication through the telephonenetwork 4 is found from the merchandise information file 601 of thecontents provider 6 through Internet 3, and the user is notified of thesearch result by speech or display on the screen.

[0053] Assume that a service constructor creates the service documentfile 210 for this service in advance by describing, for example,information related to a radio portable terminal window in C-HTML andspeech-dialog-related information in VoiceXML.

[0054] Assume also that an information sharing document like the oneshown in FIG. 4 is prepared as an example of the document described in adedicated language concerning the exchange of information between twodocuments. In the information sharing document in this embodiment, thevariables whose names are described between <shared information name>and </shared information name> are shared between the two documents. Inthis case, variables SELECT and RESULT are shared. In this case,variable SELECT is used to share a recognition result selected at aspecific point during the execution of the window-related document file213 for the radio portable terminal 1 by packet communication throughthe Internet 3 and portable terminal packet network 5, and variableRESULT is used to share a recognition result at the time of a speechdialog through the telephone network 4. An example of the method ofrealizing such sharing of variables SELECT and RESULT is a method inwhich the information management section 204 has a file in which thevalues of these variables are described, a write or reference is allowedwith respect to this file during both the execution of packetcommunication and a speech dialog, and a write or reference is made withrespect to the values of the variables in the file, as needed.

[0055]FIG. 5 shows an example of a service document file 310 for thisservice. In the case shown in FIG. 5, all documents are describedbetween <service document> and </service document>; each window-relateddocument, between <window-related document> and </window-relateddocument>; each speech-dialog-related document, between<speech-dialog-related document> and </speech-dialog-related document>;and information sharing document, between <shared information name> and</shared information name>.

[0056] The above service document file 210 is input to the document fileinput section 200 and output to the document file conversion section201. The document file conversion section 201 extracts each documentdescribed between <window-related document> and </window-relateddocument> in the service document file 210 to create the window-relateddocument file 213, and adds a description about a telephone number forspeech communication with the center 2, which is sent from the telephonenumber input section 202, to the file. The following is an example ofthe method of adding a description about a telephone number. In general,according to the description method in the case of speech communicationin C-HTML, for example, a telephone number is described as follows byusing the PHONE-TO function:

[0057] <a href=tel:0333080◯xΔ□>merchandize search</a> (“0333080◯xΔ□” isthe telephone number for speech communication.)

[0058] In a window-related description in the service document file, ata portion where the PHONE-TO function is used, a blank field is set inadvance as a telephone number field as follows:

[0059] <a href=tel:>merchandize search</a> When a description about atelephone number is to be added, a search is made for the characterstring “<a href=tel:>” in the window-related description in the servicedocument file, and the telephone number sent from the telephone numberinput section 202 is inserted. between “tel:” and “>”.

[0060] The document file conversion section 201 extracts each documentdescribed between <speech-dialog-related document> and</speech-dialog-related document> in the service document file 210 tocreate the speech-dialog-related document file 211. The service documentfile 210 also extracts each document described between <sharedinformation name> and </shared information name> in the service documentfile 210 to create the information sharing document file 212. Thedocument file conversion section 201 outputs the window-related documentfile 213, speech-dialog-related document file 211, and informationsharing document file 212, which are the conversion results on the inputservice document file, to the document file output section 203.

[0061] The document file output section 203 outputs the respectivedocuments input from the document file conversion section 201 asfollows. The window-related document file 213 is output to a place wherethe file can be used by the radio portable terminal 1 through packetcommunication (e.g., a place where the document can be displayed whenits URL is designated by using the radio portable terminal 1). Thespeech-dialog-related document file 211 is output to a place where thespeech dialog control section 207 can refer to the file (e.g., adirectory in a speech recognition unit which performs speech recognitionprocessing). The information sharing document file 212 is output to theinformation management section 204.

[0062] The user displays a window on the radio portable terminal 1 byperforming packet communication with the radio portable terminal 1through the Internet 3 and portable terminal packet network 5 and usingthe window-related document file 213. Assume that after “please inputmerchandise name: (1) foods, (2) sundries” is displayed on the screen112 of the radio portable terminal 1, the user has selected “foods”. Inthis case, the selection result is sent as a description in thewindow-related document file 213 to the information management section204 by packet communication, and is set to SELECT of the sharedinformation names. Another method of sending the result selected on thescreen to the center 2 side may be an implementation method of writingthe result in a file that can be referred to by the informationmanagement section 204, e.g., a file on the Internet, in accordance withthe description in the window-related document file 213 by using a CGI(COMPUTER GRAPHIC INTERFACE) or the like.

[0063] Upon execution of the above selection, the user performs speechcommunication with the center 1 through the telephone network 4 bydialing using, for example, the PHONE-TO function(pressing the switch101 for switching from the packet communication mode to the speechcommunication mode in FIG. 3) in accordance with the contents describedin the window-related document file 213. Since “foods” is set to sharedinformation name SELECT in the information management section 204, thespeech dialog control section 207 executes a dialog for a search withrespect to merchandise name “foods” (executing a dialog for a searchwith respect to merchandise “sundries” if “sundries” is selected) inaccordance with the contents described in the speech-dialog-relateddocument file 211. If the user utters “Chinese noodles” to themicrophone 113 of the radio portable terminal 1, the input speech issent to the speech dialog control section 207 by speech communication.The speech dialog control section 207 sends this speech to the speechrecognition section 209. The speech recognition section 209 recognizesthe speech and sends the recognition result “Chinese noodles” to thespeech dialog control section 207. The speech dialog control section 207sends the recognition result “Chinese noodles” to the informationmanagement section 204 and information search section 208.

[0064] The information search section 208 searches the merchandizeinformation file 601 in the contents provider 6 for information aboutmerchandize “Chinese noodles” through the Internet 3.

[0065] The information management section 204 sets the recognitionresult “Chinese noodles” to shared information name RESULT. Theinformation search section 204 sends the information about merchandize“Chinese noodles” to the speech conversion section 206 to provide theuser with the information by speech. The speech conversion section 206converts the information into speech and sends it to the speech dialogcontrol section 207. The speech dialog control section 207 transmitsspeech information about merchandize “Chinese noodles” to the radioportable terminal 1 by speech communication through the portableterminal telephone network 4, as needed, in accordance with thedescription in the speech-dialog-related document file 211. The radioportable terminal 1 outputs the received speech information aboutmerchandise “Chinese noodles” from the speaker 111 to provide it for theuser. In addition, in accordance with the contents described in thewindow-related document file 213, the speech recognition result set toshared information name RESULT in the information management section 204is obtained by packet communication (pressing the switch 102 forswitching from the speech communication mode to the packet communicationmode) through the Internet 3 and portable terminal packet network 5, andthe recognition result, corresponding information search result, and thelike are displayed on the screen 112 of the radio portable terminal 1,as needed.

[0066] The above description has exemplified the case wherein the useroperates the switches 101 and 102 to switch between the packetcommunication mode and the speech communication mode. However, a similareffect can also be obtained when the packet control section 205 orspeech dialog control section 207 automatically switch the modes inaccordance with the contents described in a document file or the like.

[0067] Assume that a broadband network is used as an infrastructure. Inthis case, the present invention can be practiced even under a situationin which packet communication and speech communication aresimultaneously started, and are concurrently continued without switchingbetween the packet communication mode and the speech communication modeon the way.

[0068] The following are the effects obtained by the present invention:

[0069] (1) Since the radio portable terminal communication system of thepresent invention flexibly performs, for example, exchange ofinformation search words and data by using the speech communicationfunction and packet communication function, the operability of the radioportable terminal can be improved, and search results can be checked inany of the forms of speech, images, and characters.

[0070] (2) For services for the radio portable terminal, informationabout window display and operation, used in the packet communicationmode, is described in a general-purpose radio portable terminal windowdescription language, and information about a speech dialog in thespeech communication mode is described in a general-purposespeech-dialog-related description language. This greatly saves the usertime and trouble in learning a new language, and hence reduces thenumber of steps in development.

[0071] (3) For services for the radio portable terminal, informationabout the exchange of information between the packet communication modeand the speech communication mode is described in a dedicated languageinstead of a general-purpose description language such as C-HTML orVoiceXML. This makes it possible to construct services without troubleand reduce the number of steps in development.

[0072] (4) Since the document file conversion section in the center hasthe function of adding, to a window-related document file, a descriptionabout a telephone number which is used when the radio portable terminaldials to perform speech communication, the service constructor need notdescribe a specific telephone number used for speech communication to bedone for speech recognition on the center side. This makes it possibleto reduce the number of steps in maintenance.

1. A radio portable terminal communication system characterized bycomprising a radio portable terminal having a speech communicationfunction and a packet communication function, and a center (2) linkingsaid radio portable terminal, said center (2) including a speechrecognition section (209) which recognizes a speech signal from saidradio portable terminal, an information search section (208) whichsearches for information in accordance with an input search word, aspeech dialog control section (207) which controls said speechrecognition section (209), said information search section (208), andsaid speech conversion section (206) to perform a speech dialog whenspeech communication is made upon dialing from said radio portableterminal (1), a document file input section (200) which inputs a servicedocument file used for a service provided for said radio portableterminal, which is created by making a description about at least windowdisplay, used in the packet communication, in a general-purpose radioportable terminal window description language, a description aboutoperation of said speech dialog control section, used in the speechcommunication, in a general-purpose speech-dialog-related descriptionlanguage, and a description about exchange of information between thepacket communication and the speech communication in a dedicatedlanguage, an information management section (204) which managesinformation such that the information can be shared between the packetcommunication and the speech communication, a document file conversionsection (201) which performs conversion processing for the servicedocument file to create a window-related document file for said radioportable terminal in which a description is made about at least windowdisplay used in the packet communication, a speech-dialog-relateddocument file in which a description is made about operation of saidspeech dialog control section which is used in the speech communication,and an information sharing document file in which a description is madeabout exchange of information between the packet communication and thespeech communication, a document file output section (203) which outputsthe window-related document file to a place where the file can bereferred to by said radio portable terminal through packetcommunication, outputs the speech-dialog-related document file to aplace where the file can be referred to by said speech dialog controlsection, and outputs the information sharing document file to saidinformation management section; and a packet control section (205) whichtransmits/receives information of said information management sectionto/from said radio portable terminal through packet communication.
 2. Aradio portable terminal communication system according to claim 1,characterized in that said document file conversion section of saidcenter has a function of adding, to the window-related document file, adescription of a telephone number used when dialing is made by saidradio portable terminal to perform speech communication.
 3. A radioportable terminal communication system according to claim 1,characterized in that said radio portable terminal is linked to at leastsaid speech dialog control section of said center through a portableterminal telephone network.
 4. A radio portable terminal communicationsystem according to claim 1, characterized in that said radio portableterminal acquires information by accessing an image-related documentfile through a portable terminal packet network and the Internet.
 5. Aradio portable terminal communication system according to claim 1,characterized in that said information search section searches forinformation by accessing an information file of a contents providerthrough the Internet.
 6. A radio portable terminal communication systemaccording to claim 1, characterized in that said radio portable terminalincludes a microphone, a speaker, a display screen, and a key operatingsection.
 7. A radio portable terminal communication system according toclaim 1, wherein said radio portable terminal includes a switch whichswitches from speech communication to packet communication, and a switchwhich switches from packet communication to speech communication.
 8. Aradio portable terminal communication system which performs documentconversion, upon reception of a service document file in which adescription is made about at least window display, used in packetcommunication, in a general-purpose radio portable terminal windowdescription language, a description is made about the speech dialog inthe speech communication in a general-purpose speech-dialog-relateddescription language, and a description is made about exchange ofinformation between the packet communication and the speechcommunication in a dedicated language, outputs a window-related documentfile for a radio portable terminal, a speech-dialog-related documentfile, and an information sharing document file respectively to placeswhere the files can be used, and exchanges information in packetcommunication and speech communication, as needed, when providing aservice.
 9. A radio portable terminal communication method in whichdocument conversion is performed, upon reception of a service documentfile in which a description is made about at least window display, usedin packet communication, in a general-purpose radio portable terminalwindow description language, a description is made about the speechdialog in the speech communication in a general-purposespeech-dialog-related description language, and a description is madeabout exchange of information between the packet communication and thespeech communication in a dedicated language, a window-related documentfile for a radio portable terminal, a speech-dialog-related documentfile, and an information sharing document file are output respectivelyto places where the files can be used, and information is exchanged inpacket communication and speech communication, as needed, when a serviceis provided.